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ABSTRACT 

An investigation was made of current uses of 
formative and summative teacher evaluation. A review of the 
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of incompetence (summative ) . An analysis of legal constraints and a 
series of case studies in local districts^ illustrated the fact that 
collective bargaining agreements have been a major force in the 
school district's definition and limitation of teacher evaluation 
procedures. This factor has led to emphasis on summative evaluation, 
with the result that assessment practices contribute relatively 
little to the identification of teachers 1 strengths and weaknesses or 
skill improvement i Information acquired. through. summative teacher 
evaluation is seldom used organizationally to plan staff development 
activities* A review of tfie results of the case studies produces a 
list of barriers to formative teacher evaluation. It is concluded 
that it is both feasible and advisable to emphasize formative 
evaluation arid develop ah environment conducive to its success. A set 
of guidelines is presented for developing an effective formative 
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Abstract 



'the purpose of this investigation was to Explore current uses of 
fojrniative and summative teacher evaluation, to determine the extent 

th^t the assessment of performance contributed to improving teachers' 
skills. The study also examined the characteristics of the assessment 
methods used to judge teacher performance 2h<3 effective ways of linking 
teacher evaluation with teacher development. As a result of a review of 
teacher evaluation literature, an analysis o£ legal constraints and a 
series of case studies in local districts, the authors conclude that 
as^eSSiflent practices contribute relatively little to the identification 
of teachers' strengths and weaknesses or to improving skills. Moreover , 
information acquired through teacher evaluation is seldom used 
organizationally to plan staff development activities. Problems with 
current evaluation measures are specified ah3 potential solutions are 
proposed* 



PE^OftMANCE ASSESSMENT FOR TEACHER DEVEtOPM^N'T 

Interest in assessing teacher performance has heightshsd in the last 
decade. More th^ri ever before, parents want assurance th£t teachers are 
competent professionals. Just when schools are plagued spiraling 
costs, declining enrollments and dwindling resources, educators ate 
pressed to seeR better ways of assuring quality instruction* Effective 
teacher evaluation is one way to reach that goal. 

Educators are Concerned about teacher evaluation f ot rflany specific 
reasons. However/ as Millman (1981) notes, we can distinguish between 
two major types of teacher evaluation: formative and sUfltifletive. The 
goal of formative ev^iuation is to identify teachers' own strengths and 
weaknesses and plan appropriate professional development Activities. 
Summative evaluation results, on the other hand, provide £ base for 
administrative decisions involving hiring and firing, ptQrflbt ion and 
tenure, assignments and salary. 

Clearly, formative and summative evaluations serve different 
purposes — both important. Summative evaluations are designed to ensure 
that highly qualified educators enter the profession and continue 
teaching. Formative evaluations help those already teaching to develop 
and refine vital Skills. Most teacher evaluation conducted today 
attempts to do both simultaneously. In practice, however, most 
evaluation practices address summative goals. Formative teaoher 
evaluation — potentially important in instructional improvement and 
individual development — often assumes a secondary role. 
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Neither suironative noj: formative teacher evaluations* as currently 
conducted, serve their respective purposes as well as they might. 
Neither the environment in which sununative evaluation is conducted nor 
the assessment procedure used for that evaluation aire as effective as 
they cou] d be. Formative ^valuation offers a potential seldom realized 
simply because it demand more time and effort than many evalaators can 
afford. In both cases, 2 new course of action is needed if the potential 
of teacher evaluation is to be realized. The research project described 
in this report is an attempt to chart part of that course. 

This investigation addresses problems and solutions associated with 
formative evaluation* We <3o not wish to imply that formative evaluation 
is necessarily more important than sununative. Both are potentially 
valuable. But issues of teacher selection, retention and promotion are 
already receiving widesp^e^d consideration ; we feel teacher improvement 
needs more effort and attention. If overall school improvement is our 
primary goal, then tesohets' professional growth and development become 
paramount. 

Further, performance assessirient-^the observation and rating of 
behavior — can make a significant contribution to teacher evaluation when 
used in a formative w^y , For reasons that are outlined below, the rules 
governing sununative evaluation often preclude the use of much potentially 
valuable performance 3at3* Formative evaluation, free of such 
constraints, offers 3 richer source of performance information on which 
to base teacher development 1 

Our goals in this st:u3y were first, to understand current teacher 
evaluation, both its problems and potentials; and second, to identify 
ways that evaluation oan be effectively used to promote teacher 
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development. To reach these goals, we addressed four questions: How ars 
teachers typically evaluated?, How are evaluations used to foster teacher 
improvement?, In what ways can evaluation and development be more 
effectively linked?,; and What barriers prevent linkage? 

In answering th«ese questions, we (1) reviewed current research ori 
teacher evaluation, (2) reviewed current laws> regulations and contracts 
pertaining to local evaluations, and (3) conducted case studies of 
teacher evaluation policies and practices in four school districts. In 
addition, *e conducted a working conference # emphasizing formative 
teacher evaluation practices and priorities, with task forces of 
principals* teachers and district administrators from each of the four 
case study districts. 
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RESEARCH ON TEACHER EVALUATION 



The majority of school districts look to teacher evaluation as a 
mesns of improving teaching performance (Educational Research Service, 
1978; Bolton, 1983). But given the ineffectiveness of current evaluation 
approaches, most are hot achieving this goal to any impressive degree, 
•fo understand why, we explored four dimensions of teacher evaluation: 
thS Current context; characteristics of constructive, formative 
evaluation systems? research on the status of evaluation practices in 
Schools ; and the role — actual and potent iel — of evaluation in foster ing 
teacher growth and development. 

j? h^ Context pf Teacher Evaluation 

The current context of teacher evaluation is changing. Donald 
Duftois, former coordinator of staff development in Salem, Oregon, 
explains part of the impetus behind this change: "Teacher evaluation, 
historically, has been a mess. Teachers often feel naked and defenseless 
by £hs 'inspection' and 1 report card' system. For principals, the 
tsachsr evaluation process is a gut wrenching, time consuming duty" 
(Lewis, 1982) . 

Educational administrators are aware of problems with current 
evaluations. Responding to a national survey by the American Association 
of Secondary Administrators (Lewis, 1982) , administrators specified the 
following heeds : 

« Setter definitions _of_ effective teaching . Although many 

evaluation programs attempt to define effective teaching, most 
definitions center on teachers 1 behaviors — not on appropriately 
measured outcomes . 
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• More I fe^t rirn-b^e ^oces-s . As brie superintendent put it, " We 
need to know how to evaluate people and get them to feel goo<3 
about it* H in many piacas^ the "spir it" of evaluation has been 
so structured by teacher contract agreements th^t it is almost 
"pro forma, * 

• groof_ Q £-^jig A*"* .between evaluation and , ih^t^uQtional _ 
improvement; « Until there is some specific indication that the 
process Is worth the trouble/ some say it will regain "pro 
forma * " 

m More gfiefiifjL c g on evaluation techniques . conferences, personal 
goal-setting, classroom observations—these are common 
approaches to evaluation, but administrators went to do them 
better; 

• ^^^^s ^ jj ^i vi ty to the needs of the evaluat or >.^r jmar ily the 
principal. . Many participants feel they have neither the skills 
nor tile titfe for successful evaluations. Evalu^tors wonder what 
kind oi training they should have and how they should be 
evaluated to be sure the system works. 

As these comments show, administrators are often frustrated by 
current practices* Evaluation is time consuming, potentially disruptive 
to staff -administrator relationships, often distrusted ^nrf criticized by 
teachers, and Seemingly ineffectual in improving instruction. 

Teachers also are Critical of evaluation procedures* They often 
contend that ttfe ^Sgessment methods used are inappropriate : the 
performance criteria by which they are judged are either unspecified or 
too general; classroom observations are infrequent and tupf>cf icial ; the 
factors evaluated often have little relationship to instruction ; 
supervisory evaluations are too often subjective, based mote oh personal 
characteristics th^n instructional skill; arid results are either not 
communicated or sre hoc useful in improving performance Wstriello and 



Dornbush, 19R1; Bar ion and Pen ton 1977; Bolton, 1973} „ 
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Recent surveys of teachers' attitudes about evaluation btirig ttfese 
problems into sharper focus . For example, they report that only 28 
percent of the items in school districts' evaluation checklists examined 
relate to the instructional role of the teacher. A few additional items 
deal with such relevant personal characteristics as responsibility and 
enthusiasm. But the remaining checklist items relate to behavior outside 
the classroom: memberships in organizations, and participation in 
prof essional social and administrative activities. In other words f the 
criteria used in these instruments" . . .seem to be largely Unrelated to 
improving teaching performance and provide little assistance in changing 
teaching practices." 

In studies cone" mc ted by Natriello and bornbusch (1981) , teachers 
noted thst they viewed their evaluation systems as generally Unsound , 
overly subjective and unaffected by their efforts* Teachers in these 
studies indicated that evaluation criteria were seldom shared with 
teachers , that teachers were uninformed about the information collected 
to evaluate their performance, and that minimal time was taker* to 
communicate evaluation results to them. The aut>ors note, "?ns teachers 
in our interview study reported that on the average they received formal 
evaluations from their principals once every thre* years." McPtQOVsr, in 
these teachers' per spectives> evaluations were unrelated to ths Sanctions 
or rewards of the system and hence "had little value. " 

Levin (1979) , in a summary of research on teacher evaluation* argues 
that "research provides little support for current practices in teacher 
evaluation. " He goes on to comment, "One of the few things that can be 
safely said is that the prevalent system of evaluation. . . through 
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observation by supervisors is biased and subjective. The use of 
techniques that have greater promise I'd providing objective data, such 
as observation instruments ... is as yet uncommon. w 



Dissatisfaction with current evaluation procedures and outcomes has 
prompted many educators to propose substantive revisions — revisions in 
planning, in designing performance criteria and acquiring meaningful 
data, and in communicating results to teachers. The following 
suggestions represent a concise cross^ssc tion of current thought on what 
strategies might make evaluation practices more constructive and 
effective . 

Manatt (1982) , a major proponent oi ah evaluation model being tried 
in school districts across the country f advocates an evaluation system 
manifesting these features : (1) teacfier involvement in the evaluation 
process; (2) centralized and collaborative development of performance 
criteria based oh research and on local priorities; (3) goal setting; 
(5) multi-dimensional methods for assessing teachers' skills, including 
objective data gathering, self- and peet evaluation; (5) analysis of 
results with teachers and development o£ specific job targets for 
improvement; and (6) inclusion of a pre^cPbservatibn confer* ^e to acquire 
background data, and a post-observation Conference to mutually analyze 
classroom data and set goals for improvement. 

Manatt' s model strongly reflects th^ positive impact of clinical 
supervision, a collegial process of professional development designed by 
Harvard School of Education faculty in tr*e 1960s. Clinical supervision 



Designing a More Constructive Env i ronfljeji t 
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is a system in which teacher and supervisor work together "to set goals 
and determine progress. This collaborative model includes three major 
steps: pre-observation conferences to exchange background information 
and to mutually establish goals and methods for gathering data; multiple 
classroom observations that include collection of objective data; arid 
post-observation conferences to analyze arid verify data $rtd to 
collaboratively develop a systematic plan for improvement. In add? tion , 
teacher arid supervisor communicate extensively throughout the evaluation 
process to ensure that the teacher has a real voice in determining 
evaluation procedures and setting goals for professional growth. 
Although clinical supervision methods have been adopted procedurally by 
districts across the country, the heart of the teacher development 
process — frequent observation and discussion — has not been successfully 
incorporated into most local systems. 

In response to valid concerns about the perfunctory nature of most 
evaluations and reliance on subjective observational data , many educators 
urge the use of (1) assessment methods that give more adequate and 
objective data about classroom interactions (verbatim records, charts of 
classroom interactions, records of questioning, or reinforcement 
strategies) ; and (2) use of multiple evaluation procedures (student and 
peer evaluation, assessment of student products) to provide a more 
comprehensive picture of the teacher's performance (C Hanlon arid 
Mortensen, 1977). Levin (1979) reinforces the need fbt "more extensive 
use of student evaluations and less reliance on ratings by principals and 
other supervisors. " He also concludes that "reliance on a single 
evaluation technique is unwise" since it reduces the possibility that the 
teacher will be judged fairly. 
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Following a comprehensive analysis of current teacher evaluation 
practices, Darling-Hammond, Wise and Pease (1983) specify four minimal 
conditions for a successful teaches: evaluation system: 

• All individuals in the system understand the criteria and 
processes for teacher evaluation; 

• All participants understand how these criteria and processes 
relate to the basic goals of the organization; i»e., there is a 
snared sense that the criteria reflect the most important 
aspects of teaching, that the evaluation system is consonant 
with their educational goals and conceptions of teaching; 

• Teachers perceive that the evaluation procedure enables and 
motivates them to improve their performance; and principals 
perceive that it enables them to provide instructional 
leadership; 

• All individuals in the evaluation perceive that the evaluation 
procedure allows them to strike a balance "between adaptation 
and adaptability, between stability to handle present demands 
ahdf legibility to handle unanticipated demands" _( Weic ^jr 1982^ 
p. 674). That is, it allows participants to achieve a balance 
between control and autonomy. 

Achieving a Mora C o n structive Environment 

How extensively do current school practices incorporate these 
commonly advocated criteria? In summarizing a series of surveys of 
evaluation practices, Knapp (1982) contends that despite strong advocacy 
of multiple information sources, involvement of students and peers, and 
more objective means of collecting data , schools have not really changed 
their approach to teacher evaluation. Principals still do most of the 



observing ; staff are seldom involved in planning; and there is little 



real effort to use evaluation outcomes in designing constructive staff 
development. 
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Similarly, a recent analysis of 32 Highly-developed current teacher 
evaluation systems across the country, Completed by the Rand Corporation 
under sponsorship of the National Institute of Education, provides these 
insights regarding evaluation piracticss (Mclaughlin, 1982) : 

Exemplary programs displayed a number of common features. Nearly ail 
of the 32 programs studied required a pir^avaluat ion conference (88%) , 
classroom observation (100%) , post-evaluation conference (100%) , a 
written action plan following evaluation (88%), action plan follow-up 
(81%), and the participating principal primary evatuator (78%). Few, 
however, used self-evaluation (38%) , peer evaluation (25%), or students 1 
achievement data (22%) in Evaluating taachecs. 

Despite these similarities, McLaughlin suggests "•••there is scant 
agreement about instrumentation, frequency of evaluation , role of the 
teacher in the process, or how the information could or should inform 
other district activities. " Iri bthet wct:33, little consensus exists 
about "best practice." Moreover, although 74 percent of the districts 
named school improvement or staff development as the primary goal of the 
system, few districts established the necessary links between teacher 
evaluation and staff development to maKe that goal achievable. There is, 
as the study notes, "a general lack of integration between teacher 
evaluation and staff development or di^tsitft curriculum guides." Thus, 
although exemplary programs appear to emphasize staff development and 
school improvement, teacher evaluation overrates, more often than not, as 
ah independent, self-contained system, HQt an integral component of a 
broader staff development program- 
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Effective Formative Evaluation Elusive 

As recent studies point out* even highly-develbpec! fce^chet evaluation 
programs seem to lack procedures or organizational link^ ss^shtial for 
systematic individual or staff development through teache* evaluation. 

As Kriapp (1982) notes, strong formative evaluation i ^grams required 
both staff involvement and a specified relationship bsty^sn teacher 
development and evaluation. But despite the urgings of researchers and 
educators themselves , not much has happened. Knapp stated although 
effective evaluation of individual teachers can provide *a xo&te accurate 
picture of an individual teacher's needs than* for example, the group 

heeds assessments commonly used ... systematic evaluation <b£ individual 

» _ _ _ — 

teachers does riot as yet appear to be a standard part oi 3fca£f 

development planning . * 

Holley (1982) contends that districts need to make b^ttet use of 
evaluation data. "When evaiuator ratings are summarized acrc>sg 
competencies or areas, the training needs of both evaluates and 
evaiuators emerge." District and building summaries c^n be instrumental 
in identifying staff development needs. "The data," arrgues Holley, 
"should be captured and used for the improvement of both tbs evaluation 
process arid instruction. " 

While teacher evaluation practices are becoming more systematic 
procedurally, most are still insufficient to support viable teacher 
improvement programs; Teachers want> at the very least * 2*n evaluation 
system that provides accurate information on classroom needs* opportunity 
to acquire and master new learning approaches, and collegia! support when 
instigating needed changes. These activities demand mote time, 
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instructional involvement and more thorough assessment than mihy 
principals seem to find manageable. As a consequence -, practices become 
more formalized, remaining basically unchanged. Moreover > a£ the next 
section indicates/ changes in practice may occur more in response to 
external pressures than to internal needs. 
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FACTORS ft£<3U£MING TEACHER EVALUATION PRACTICE 



State teacher evaluation laws and regujations can influence local 
evaluation practices , as Can collective bargaining agreements. This 
analysis explores whether these laws and contracts promote or constrain 
the use of evaluation for teacher development. 

We begin the analysis of state laws and regulations with a brief 
summary of the national picture, then comment on district/teacher 
association contracts* 

Teacher Evaluation Eayrs. 

Twenty-six states currently have laws requiring teacher evaluation 
according to Wuhs and Manatt (1983) . Though ah equal number currently 
have no laws, the numbs t vf such laws has increased dramatically during 
the past twelve years, vith over 80% of all laws enacted since 1971. 

Wuhs and Mariatt, tot example , reports that in nearly all states 
improvement is a pr inmy purpose? in almost half, evaluation data are 
also used for personnel putposes. Beckham (1981), by contrast, reports 
that less than half of tfte states list school or teacher improvement as 
their primary purpose, and that the remainder of laws serve personnel 
decision making functions, This apparent discrepancy may simply indicate 
that most evaluation la«*s Serve multiple purposes and often claim to 
address both formative and summative issues - 

Three-quarters of the States leave control of evaluation procedures 
to local districts. V^tf few specify criteria to be evaluated. And 
still fewer provide any guidelines for the development of local systems. 
So it is apparently local decisions hot state mandates, that determine 
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most district evaluation procedures. Sin<?fc local procedures are often 
negotiated as part of collective bargaining #gteements, as a general 
ruler state laws would appear to have minimal influence on promoting or 
limiting any local emphasis on formative teacher evaluation. They may, 
however/ indirectly impede formative practises by requiring certain 
procedures such as use of uniform, mandated evaluation reports, or rigid 
specification of teaching criteria unrelated to district identified 
teaching priorities. In such instances, evaluators may first meet thfc 
formal f state-mandated requirements and then way decide that 
implementation of added forniative practices is not (a) necessary or (b) 
possible / given other time demands. 

Although some state laws do include Some provision for teacher 
development, most are far less prescriptive fcfiari the law passed in 
Connecticut for the purpos of mandating formative evaluation. 
Connecticut State Department of Education guidelines specify the 
following evaluation methods. 

9 Cooperative planning between professionals and evaluators of the 
objectives of each individual evaluations the evaluation 
procedures, and the process of evaluating the system by staff, 

0 Clear specification and common Nation of the evaluation purposes 
as well as the specific responsibilities and tasks that will 
serve as the frame of reference £o£ individual evaluations, 

0 Opportunity for teachers to evaluate themselves in positive and 
constructive ways, and 

0 Emphasis on diagnostic rather than evaluative assessment with 
specific attention given to ahaly*iH§ difficulties, planning 
improvements and providing clear, personalized, constructive 
feed back. 

As our discussion will show, these state guidelines attempt to establish 
a stronger tie between teacher evaluation and teacher development than do 
most. 
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The Impact of Col lec tive Bargaining Agreements 

ft major fbrtfe in defining arid limiting district teacher evaluation 
procedures has been the collective bargaining agreement, Its chief 
impact has been to provide due process safeguards for telenets. 
According to Strike & Bull (1981) , who studied numerous such agreements , 
these contracts affect the evaluation process by: specifying the 
frequency of evaluations or observations, informing teachers of 
evaluation criteria, restricting some methods of information gathering 
(e.g., unannounced visits, secret monitoring, electronic ecjuipmeht, 
etc.), and specifying who can and cannot participate in the evaluation 
process. They also often require formal communication of evaluation 
results, regulate written reports (e.g., confidentiality* opportunity for 
a written response by teachers) -, require remediation for negative 
evaluations, allow union representation at all conferences and 
procedures , and necessitate that notice and reasons be filed for 
disciplinary action, iiisihissal or demotion. 

Overtly, the effect of these contracted agreements i£ to promote 
uniformity and specificity in evaluation procedures. But because of the 
adversarial nature of many contract negotiations, teacher evaluation is 
becoming more rule governed and "focused more on adherence to clearly 
specified minimum tfotK standards" (Darling -Hammond , et ^1*, 1983). 
Collective bargaining has done little to promote links between teacher 
evaluation and individual development. Although it has often clarified 
evaluation requirements, it also has had the effect of maKing evaluation 
procedures more ijnpetscnal and rule governed and unintentionally 
introduced another dimension of divisiveness into the process. 
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The legal anc 1 contractual factors governing teacher evaluation are 
typically designed to standardize evaluation requirements arid to promote 
due process in sutnmatitfS evaluation. By promoting adherence to fair 
practices in personnel decision making, however, they have, in effect, 
directed attention towards legal requirements and away from methods for 
promoting teacher growth and development. Although it is encouraging to 
find some state laws attempting to strike a balance between formative and 
summative teacher evaluation, the laws only set ah overall context for 
practice in districts eftcl schools. Their effectiveness still depends on 
incerpretavion and implementation. Regulations may indeed enhance the 
potential for improvement, or they T^ay be viewed just one more 
requirement to be* ro^t, tftus having little substantive impact on 
instructional changes. 
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DISTRICT TEACHER EVALUATION PRACTICES 

What impact do existing laws and contracts actually have on local 
evaluation practices? bo the same teacher evaluation issues identified 
in national studies also concern local districts? what practices do 
local programs use to promote teacher development? To answer these 
questions, we asked four Pacific Northwest school districts to 
participate in case studies of their teacher evaluation systems. The 
results added much detail to bur understanding of the evaluation 
environment. 

Case S t udy_ Pesc r ipt ion 

To learn about teacher evaluation practices in these districts, we 
conducted 17 interviews with district administrators in charge of teacher 
evaluation and v?itH building principals (elementary, junior high, and 
high school) • In addition, each principal was asked to name four 
teachers ftoft her or Bis school who would respond to a questionnaire bh 
teacher evaluation practices. Forty-eight teachers received 
questionnaires, and thirty-six responded. 

Participants vers asked to describe teacher evaluation practices from 
their viewpoint- Further, they were asked if and how they used results 
to plan teacher development. Interviews and questionnaires touched on 
state and district policies, development of evaluation procedures, 
methods for gathering information oh teacher performance, methods for 
communicating evaluation results to teachers, and relative satisfaction 
with their evaluation system. In outlining ways evaluation data are 
used, administrators and principals described the specific 
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deeisions^-summative and formative — influenced by the results. They were 
aiJ^o asked what rolr teacher evaluation plays in promoting teacher growth 
and improvement . Results of the interviews and questionnaires are 
koicQx&c ized below. 

Cas^ 5 tudy Results 

In summarizing case study results, we found evaluation procedures to 
be strikingly similar across districts. For example, all districts used 
a three-stage evaluation process including a pre- and post-observation 
conference, and classroom observations The observations, conducted 
either by principals or vice-principals, were the central feature of all 
evaluations. They occurred formally either bribe or twice a year. Peers 
and Students were seldom involved in the evaluation? self-evaluations 
wer^ cursory if done at all, and student achievement scores were riot 
us^cL Results of the evaluatbr's observation were communicated both in 
person and in writing to the teacher. The written reports called for 
supervisors to describe teachers » strengths and weaknesses on either 
St$t0 or locally specified criteria; None of the districts used rating 
Scales or indications of performance levels to identify teachers' 
Skills* Finally, training provided evaluators ranged, in brie district, 
from a frequent, integrated program that involved all staff to 
intermittent or sporadic training in other districts. In addition, both 
teachers and administrators saw room for improvement in the evaluation 
process and made specific recommendations about needed changes • 

^ teachers' Perspectives on Needed Changes . The primary goal of our 
<??>3te studies was to identify f irriers precluding use of teacher 
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evaluation result^ tot teacher growth and development* iti the 
questionnaire^ taas^ers were asked for their perspectives on 

o Needed changes in the teacher's role in evaluation, 
v Needed changes in district procedures, and 

• Ideas for improving the quality of teaching in the district. 

With respect to the teacher's role, over half (53%) spontaneously 
urged more opportunity for collegial observation, and for Self -evaluation 
through goal setting and videotaping . Others suggested giving teachers 
more knowledge a*>oUt what constitutes effective teaching, and more 
proficiency in evaluating lessons. 

Recommendations for improvements in the overall evaluation system 
were far more extensive. Repeatedly, teachers suggested mare frequent, 
formal and inform! observations, greater use of peer observation and 
self-evaluation, end itiore effective preparation and training for 
evaluators . In a$<3ition, they called for better observational 
i*tr?:tegies, more effective communication of results^ witfi Emphasis oh 
specific suggestions for improvement * increased skill among evaluators, 
and better general management of evaluation. Teachers alsc? noted that 
they needed quality ihservice training to improve their skills. 

Teachers seemeS to agree that to be effective, evaluation must (1) be 
a valued schoolwiSe priority, hot just a requirement; (2) ocdixt 
frequently enough §o that outcomes reflect actual classroom activities; 
(3) incorporate mettfoSs that provide relevant, specific, and complete 
information? and (4) involve evaluators trained to provide specific* 
useful suggestions fot improvement. Repeatedly teachers called for more 
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frequent feedback* arid for constructive criticism, not "vagus 
generalities that hide mediocre teaching." 

Administrators 1 Perspect ives on Heeded Changes * How satisfied vere 
principals and district staff with their evaluation systems** Hs- ponses 
differed considerably across districts^ 

In two districts , administrators were generally satisfied with the 
evaluation process, but concerned with the amount of time available to 
conduct observations. In the two other case study districts* 
administrators were less satisfied. Reasons for dissatisfaction included 
teachers* lack of trust in the evaluation process, lack of clarity in 
criteria, and the fact that evaluation seemed n 3re oriented to meeting 
state standards than promoting improvements. 

Similarxy, not all agreed that teacher evaluation led to teachor 
improvement. Some felt that thr: goal setting process was a major step 
toward improvement, and that increasingly, evaluation was focusing more 
on improvement than on judgment. Others felt the link was veaR at best* 
Principals also generally acknowledged that evaluation results ware hot 
directly used to plan school or distr ictwide staff development, and that 
local supervisors did not include evaluation results in setting 
instructional priorities. Evaluation was, however/ used by Some 
evaluators to help teachers identify individual goals and to specify a 
plan of action for the year. The completion of these plans an3 their 
effect on instruction was seldom monitored. 

These administrators cited four major barriers limiting th<& 
development of a more formative evaluation system: (1) teacups' lack of 
trust in the process; (2) insufficient time for evaluation; (3) the 
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adversarial context of evaluation; and {4j principals 1 skills as 
evaluators. The trust and time issues w£r§ most frequently mentioned. 
Principalis also noted these problems: inconsistent evaluation 
procedures , imprecise requirements, lack ot training for evaluators, 
imprecise dismissal procedures, overly general evaluation outcomes, 
teachers' resistance to change and inade^iJste staff development* 
Administrators noted too that many principals did hot know how to 
establish evaluation programs or set realistic priorities* 

When asked how evaluation could be mtfrS directly related to the 
iraprb demerit of teaching, administrators recommended changes in system 
management, including increased staff involvement in goal setting an^ 
emphasis on improvement as a district pric?tity, improved methods of 
conducting observations, more time allowed for evaluation ^ai 
observations, development of evaluators* skills, a stronger link between 
evaluation and staff development, and accountability for all principals 
conducting evaluations. 

Yes^ say supervisors, evaluation cgu1<3 be more effective in 
diagnosing teachers 1 heeds and improving their skills — bet only it the 
process changes in many ways. And the major changes called for closely 
parallel thos* concerns identified in national studies of teacher 
evaluation. 

k Conference on Teacher Evaluation 

As a conclusion to the case studies, invited teams of 
educators—each team including a district Administrator, principal and 
teacher—from each of the four case study districts to attend a working 
conference and consider, in greater depth, tnetnods for more effectively 



0859e 



linking evaluation and staff development within the districts* 
Conference teams discussed two major issues: (1) the barriers to more 



formative evaluation, and (2) potential ways of linking evaluation more 
cxosaly co teacher improvement. 



After reviewing the results of the case stud'^s, Conference 
participants worked together to produce the following common list of 
barriers to formative teacher evaluation (listed in order oi: importance) 



in their districts: 

1. Evaluators of ten lack important skills needed to evaluate, and 
the training heeded to solve this problem is frequently not 
available, hot used, or ineffective. At least two sets of 
skills are lacking: 



a. skills in evaluating teacher performance, and 

b. skills in communicating with teachers about the evaluation 
process and results. 

2. There is often insufficient time for both evaluation and 
foiiowupi A continuous cycle of feedback and growth is needed 
to promote teacher development; The competing demands of 
education frequently push evaluation to a low priority status. 

3. The process (esj for linking staff development and teacher 
evaluation are not clear. Wj lack a clear goal for formative 
teacher evaluation (i.e»* an image of the desired system) and a 
plan for achieving that goal. State laws and district policies 
and procedures do not reflect that goal; and individuals 

* (teachers and administrators alike) within the system have yet 
to provide the support heeded to make evaluation results truly 
productive. Despite an important emphasis on protecting the due 
process rights of teachers, evaluation systems Jack a similar 
commitment to promoting professional development. 

4. Trust in the evaluation system is often lacking among educators 
functioning within that system. Unclear or unacceptable 
performance criteria combined with lack of teacher involvement 
in developing performance criteria and infrequent and 
superficial observations, tend to breeJ skepticism among 
teachers about the value of results. The adversarial 
relationship between districts and collective bargaining units 
also breeds distrust. 
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Having identified a list of significant barriers, conference 
participants then turned to the task of finding solutions. Simple 
solutions were not expected nor sought. Nevertheless, participants 
generated a list of starting points from which to begin various assaults 
oh key barriers. 

Individuals noted that commitment to effective teacher evaluation as 
an important means to school improvement mast be given priority status 
within the districts In addition, district staff need to determine the 
foremost purpose of their evaluation — either staff improvement or 
personnel decision making — and develop procedures appropriate to 
accomplishing that purpose. Added to these initial steps, conference 
participants called for: 

• Involvement of all staff in the planning process, 

• Identification of meaningful and relevant performance criteria 
as the basis of the evaluation, 

• Evaluatbrs trained to pinpoint teachers' skills in need of 
development, 

• Inclusion of other sources °f information about teachers' 
proficiency including data from peers, self and students, 

• Development of a comprehensive staff development program for 
evaluators as well as teachers, and 

• Adequate resources — time and money — to develop a thorough 
program of feedback and development for staff. 
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IN SEARCH OF SOLUTIONS 



teacher evaluation, as the case studies and summaries of national 
teacher evaluation practices indicate, is viewed as an important 
s^booi^basesd method for improving teachers 1 skills. In practice, 
hbv^er» evaluation has substantially less impact than is desired • 
Despite increasing emphasis on" improving the quality of teacher 
evaluation programs, most " improvemen ts " seem directed at systematizing 
ptfo^edures. As a result, regulations abound. Most teacher evaluation 
systems now require regular annual or biannual evaluations, specify the 
aen^fei performance criteria to be used, define the procedures in the 
evaluation cycle, call for written documentaion of results * and require 
that those results be formally reviewed with teachers. Some teactfefc 
evaluation programs haves increased teachers 1 participation in evaluation 
by including personal goal setting and carefully outlining plans fbfc 
accomplishing goals • But educators generally concur that even highly 
developed evaluation systems are not helping teachers either individually 
or fctfllectively to improve their skills, 

Some ot: the changes needed to make evaluation more ef fective-^f torn 
Sachets* and supervisors 1 perspectives — as mentioned are these: 
tethers and administrators need to collaborate bh the goals, criteria 
and procedures for evaluation; evaluation procedures need to be geared to 
dt^no^ing teachers* skills and aiding them in making instructional 
ch^r^a; supervisors heed mores time* support, and training to diagnose 
instructional problems; and Evaluation methods need to be more soundly 
bssed and linked to rewards and sanctions within the organization. 
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Persistent problems suggest that a number of substantial changes ate 
needed in the organization of evaluation systems ; the emphasis given 
instructional improvment f the Kind and quality of information provided 
teachers, and in the ways evaluation is conducted. 

Making the Purpose Clear 

Most teacher evaluation systems have attempted to simultaneously 
accomplisn two potentially conflicting purposes: to encourage teacher 
development and improve instructional quality (formative) and to judge 
teacher effectiveness and acquits evidence of incompetence (summative) • 
As a result, most have succeeded only marginally* doing whatever 
necessary to meet minimal legal requirements. In practice, summative 
evaluation has usually taken jpreeed^noe; formative activities, by nature 
more time consuming and demanding* has been dealt with superficially if 
at all* As a consequence, evaluasicm systems have not provided adequate 
diagnosis and assistance to support teacher improvement. Further, the 
dual purpose of most evaluation f>£o9faSs has increased tension* in many 
instances undermining the trust* flonesty , openness and motivation heeded 
to promote experimentation with new teaching approaches. For formative 
evaluation to work most effectively* it heeds first to be specified as a 
primary purpose of evaluation, afld second to include appropriate 
procedures for acquiring information* 

In the authors' opinion, it is both feasible and advisable to 
emphasize formative evaluation and to develop an environment conducive to 
its success. Although this may be accomplished in many ways, success of 
the activity appears to hinge on a number of important steps. First, it 
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demands an openness to change and commitment to improvement. Teachers 
and supervisors must agree bri priorities, sharing decisions on what needs 
to be accomplished and when. Second, it involve c^peratively selecting 
training opportunities, determining the degree to Vhich objectives are 
accomplished and new skills learned (selecting criteria for performance) , 
incorporating multiple sources of information to determine the effect of 
new teaching approaches on studer s, and sharing rs^utces to support 
changing behaviors* In effect * success will rscttfite that teachers and 
administrators work together cooperatively * as mutually supportive allies. 

Emphasizing teacher development as a major ptfrjx^e of evaluation 
requires strategies different from those commonly usefl in summative 
evaluation— as the following paragraphs show. 

Improving the Quality and Availability of InfoEfl ^tjU^ 

Responsibility for summative evaluation faX%0 m&t frequently to the 
school's principal or vice-principal; More oftfitf than not* orice-a-year 
observation is the sole basis for determining taach^rs 1 performance and 
identifying needed skills. In formative evaluation/ numerous information 
sources may be tapped. Peers, students f and tea^hejrs themselves offer a 
broad spectrum of perspectives, thus increasing the o3ds that strengths 
and needs will be accurately identified. Furthet, jTeSpbhsibility for 
formative evaluation can be placed first and foremost in the hands of 
each individual teacher and employ relevant, useful cteta from 
sources—like students and fellow teachers — who aire thoroughly familiar 
with the classroom environment. 
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Many othsr information resources; usually disregarded in summative 
evaluation, ste appropriate in formative evaluation* For example , 
student achievement data can be useful . Although standardized 
achievement t*st data are considered an inappropriate ba'^is for summative 
evaluation, teachers 1 own day-to-day classroom measures provide 
diagnostic information that may be a vital component of a teacher's 
self -evaluation of instructional strengths arid weaknesses. 

Ensuring Ad^QUste P^rforju^ncj? Criteria 

The significance of relevant performance criteria can scarcely be 
overstated. Criteria present stumbling blocks to sound assessment if and 
when they : 

• Fo^us on personal characteristics rather than instructional 
skills, 

• Call for inferences about teaching behavior that compromise 
reliability. 

• Are too general to provide diagnostic information % 

• Ars unclear or unrelated to professional practices of teachers • 

Formative teacher evaluation can be more effective if these factors are 
considered in establishing the performance criteria that key the process. 

First, criteria should relate to student outcomes defined as 
important by current research and be identified collaboratively by 
teachers and principals. The emphasis should be bri behaviors that seem 
to make a difference, such as "the clarity of a teacher 's 
presentations. 11 Although researchers acknowledge tliat not all behavior 
works in all settings r there is growing evidence now that certain 
instructional methods, such as those associated with direct instruction, 
have impact on student achievement in many contexts. 
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Second , each performance criterion should describe some teacher 
behavior or characteristic oi tfii classroom environment that can be 
consistently evaluated— regardless of when the evaluation occurs or who 
observes the behavior. As MillSan (1982) notes, "How a teacher is judged 
often depends oh who does the observation and bh what day it is 
performed. " 

Third, each criterion should he clear and specific enough to yield 
diagnostic information. Rating tfrat do not suggest how performance 
might be improved are of little VAius to a teacher. 

Fourth, each performance Sust be endorsed by the teacher as 

appropriate for his or her cia^stACHtw Tto merit such endorsement ^ 
criteria must be (1) valid within the unique learning environment 
established by the teacher, (2) appropriate for the content taught and 
the instructional method (s) used fcy that teacher, and (3) flexible enough 
to allow the teacher a chbic^ ot instructional strategies. 

Fifth, performance criteria ru*e<3 to be practical as well as 
relevant. Though criteria need to be diagnostic, a long list of minutely 
specific behaviors that cannot be rsted* communicated or addressed in a 
reasonable time is likely to generate confusing feedback and planning 
problems. Some balance is needed Between diagnostic precision and 
cumbersome detail. If the li^t important performance criteria grows 
excessive^ evaluatbrs should 3et priorities and address only part of the 
list in a given term, semester, or year. 

Sixth, in reviewing criteria* the teacher and evaluator should 
identify relatively weak area£ of performance and mutually design steps 
to improve those areas . Moreover , in all formative evaluations, it is 



0859e 




inappropriate to compare one te&ch^t's performance with that of another 
for the purpose of ranking teacher k/ proficiency. The iinicjueness of 
learning environments, student gt<9tf|>3, instructional styles and teacher 
groups make such comparisons meaningless. In addition, using teacher 
norms or ranks invariably promote 5 defensiveness that is 
counterproductive. After all, pt^^ssional development, not criticism 
for its own sake, is the whole poirit of the system. 

Finally, all desirable change depends on establishment of effective 
channels of communication between fcsA<;her and supervisor. Fot many 
teachers, evaluation results havo not been communicated eithet 
constructively or d iag nos t ically • ^ one educator commented, * fault 
finding without suggestions for r^w^dy , categorizations (e.g. • good, 
average) that provide little di^grtostic assistance, generalities that 
appear to have little factual b*s£s and reports that make no clear 
contr ibution to organizational go^ls" are not effective forms of 
communication (Bolton, 1973)- This is true, of coarse, for either 
formative or samraative evaluation > 

Useful evaluation results promote instructional awareness arid prompt 
change. To do so, presentation o$ feedback should occur in an atmosphere 
of mutual problem solving and ttu^t * - teachers need evidence that their 
efforts toward professional grbvtn ^ill be rewarded with personal 
recognition and support. As Da r 1 i h9^8fcmmond , et al. (1983) state, 
"Effectively changing the behavior of another person requites enlisting 
the cooperation and motivation of that person, in addition to providing 
guidance on the steps needed for improvement to occur." 
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Effective For mat ive Evalua t ion 

assessing teachers' performance is an important task; It is hoped 



that the foregoing discussion will promote better understanding of 
effective evaluation practice, white at the same time encouraging 
educators to attempt alternative* dynamic approaches to the formative 
evaluation process. Those alternatives can work to improve instruction 
if the following guidelines are observed: 



• select ^j^^ h^^^^44atcti^ TOluatidn Purpose , The purpose of an 
Evaluation system must be clearly identified and understood in 
order tc Select appropriate methods. The same procedures cannot 
constructively and simultaneously serve the needs of those 
interested in promoting teacher development and those 
responsible for personnel decisions. Both sets °^_ rie ?^ s are 
important. But different methods are needed to address 
different purposes; 

• ^yol^e-jjgQ^ers in evaluation; _?eachers should be involved in 
gjl phases of developing and operating formative systems. Any 
evaluation program that does not reflect the interests, 
concerns > aspirations and needs of teachers is doomed to 
failure^ By the same tokens teachers must have constructive, 
attitudes to make the system work. Teaching must be regarded as 
a skill to be learned and participants must be willing managers 
of their own development*. ready to consider, explore, and 
practice new teaching skills. 

• p to v ideV Relevant ^r aining . All evaluators and staff must be 
thoroughly trained. Everyone involved in the evaluation should 
know how to use evaluation instruments to acquire useful, 
objective data, interpret results, and «se those results to 
advantage. Similarly, evaluators should be trained to provide 
feedback to teachers which is clear, precise and sufficiently 
diagnostic to promote realistic plans for improvement. 



• Increase Sources of Evaluation Data . Thorough formative 
evaluation should include the perspectives of students, peers, 
teachers themselves, and supervisors and incorporate several 
kinds of observation not just once-a-year classroom spot checks. 

• tJse Meaningful Criteria. Performance criteria must be relevant 
to desired student outcomes* specific enough to be useful in 
planning professional development, and accepted as important by 
each teacher to whom they will apply. 
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m Ral^kf jh&B\A^ s to 0rganizatic 'h g4 -Qo^ls; Evaluation results 

should be used by both teachers and stat " development planners 
to set: training priorities and to evaluate success in achieving 
organizational and personal goals* Successful evaluation is 
cie^riy tied to organizational planning. Moreover the system 
its^i£ should be evaluated regularly before any procedures 
become so firmly entrenched tfiat they are unresponsive to change. 

The entire framework of this proposal for formative evaluation rests 
oh one overriding assumption: That is, School managers arid teachers 
alike function best withiri ari environment: characterized by mutual 
support, by tegpect arid concern for personal growth, and for the 
well-being of £taff and students. Where sQCh an environment exists, 
formative teacher evaluation offers greafc potential for helping teachers 
learn to teach better. 

Given current economic conditions and declining enrollments^ fewer 
new teachers ars entering the profession* Therefore improving the 
quality of instruction demands developing the skills of teachers already 
in the classroom. Formative evaluation*-^ system inherently sensitive to 
teachers 1 own Hsed3 and goals — can be a vital step in strengthening 
instructional effectiveness nationwide. 
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